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Abstract 

In this paper we consider the Max-Weight protocol for routing and scheduhng in wireless networks under an 
adversarial model. This protocol has received a significant amount of attention dating back to the papers of Tassiulas 
and Ephremides. In particular, this protocol is known to be throughput- optimal whenever the traffic patterns and 
propagation conditions are governed by a stationary stochastic process. 

However, the standard proof of throughput optimality (which is based on the negative drift of a quadratic potential 
function) does not hold when the traffic patterns and the edge capacity changes over time are governed by an arbitrary 
adversarial process. Such an environment appears frequently in many practical wireless scenarios when the assumption 
that channel conditions are governed by a stationary stochastic process does not readily apply. 

In this paper we prove that even in the above adversarial setting, the Max-Weight protocol keeps the queues 
in the network stable (i.e. keeps the queue sizes bounded) whenever this is feasible by some routing and scheduling 
algorithm. However, the proof is somewhat more complex than the negative potential drift argument that applied 
in the stationary case. Our proof holds for any arbitrary interference relationships among edges. We also prove the 
stability of ^-approximate Max-Weight under the adversarial model. We conclude the paper with a discussion of 
queue sizes in the adversarial model as well as a set of simulation results. 

I. Introduction 

We consider the performance of the Max- Weight routing and scheduling algorithm in adversarial networks. Max- 
Weight has been one of the most studied algorithms Q, ifTSl . |[T6ll since it was introduced in the work of Tassiulas 
and Ephremides 1201 , 1211 and Awerbuch and Leighton O, ||9l. The key property of Max- Weight is that for a fixed 
set of flows it is throughput optimal in stochastic networks with a wide variety of scenarios 1201 . ifTTIl . ifTSl . even 
though it may fail to provide maximum stability in a scenario with flow-level dynamics |22|. That is, for a fixed 
set of flows the Max- Weight protocol keeps the queues in the network stable whenever this is feasible by some 
routing and scheduling algorithm. Moreover, we can obtain a bound on the amount of packets in the system that 
is polynomial in the network size. 

However, the standard analyses of the Max-Weight algorithm make critical use of the fact that the channel 
conditions and the traffic patterns are governed by stationary stochastic processes. The stationary stochastic model 
deals with the case where traffic patterns do not deviate much from their time-average behavior. On the other hand. 
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we shall consider the worst case traffic scenario modeled by adversarial models. If an adversary chooses traffic 
patterns and interference conditions, and edge capacities change over time in an arbitrary way, then the question 
remains as to whether a system running under Max- Weight can be unstable. It is important to model the worst 
(adversarial) case because non-evenly distributed traffic patterns are observed over time in many queuing models. 
A typical adversarial scenario is a military communication network, in which there could exist adversarial jammers. 
Once it is jammed, the victim link will have zero capacity or very weak capacity. Ensuring stability under the worst 
case is crucial in many such systems. The aim of the current paper is to resolve this question. 

Previous work has shed some light on this issue. In |5 1 it was shown that for a single transmitter sending data 
over one-hop edges to a set of mobile users, if the set of non-zero channel rates can approach zero arbitrarily 
closely, then no protocol can be stable. However, since this is a fairly unnatural condition, O looked at the more 
natural setting in which all rate sets are finite. For this case a stable protocol was given but it was a somewhat 
unnatural protocol that relies on a lot of bookkeeping. The stability of a more natural protocol such as Max- Weight 
was left unresolved. 

In some adversarial setting, the stability of Max-Weight in static networks was proven in fTl, and the stability of 
Max-Weight was proven in dynamic networks with single-commodity demands |7| and multicommodity demands 
121 . However, these proofs only applied to the case when each edge could be scheduled independently (in other 
words, the decision to transmit on an edge has no affect on the edge rates on other edges). This is obviously not 
a suitable model for wireless transmissions in which edges can clearly affect each other. As discussed in |5|, the 
stability of Max- Weight was not known in the adversarial setting for the case of interfering edges, even if we only 
have one node that transmits. 

In this paper we resolve the question of the stability of Max- Weight in general adversarial networks. We present 
an adversarial model of interfering edges and show that the Max- Weight policy always maintains stability as long as 
we are strictly within the network stability region, even when the stability region is allowed to change over time. We 
consider a very general adversarial model that can be applied to all the possible interference conditions, including 
k-hop interference |[T9ll , independent set constraint |[T2ll . flSl . and node exclusive constraints O, (H, |[T4ll . ifTTl . 
Our proof gives a bound on the queue size that is exponential in the network size. (This is unlike the stochastic 
case.) However, we also demonstrate (using an example inspired by |6|) that such exponential queue sizes can 
occur. Although computing the optimal solution of Max- Weight is computationally NP hard for many scenarios, 
in many practical wireless networks ^-approximate solutions can be computed in polynomial time QO], |[T2ll . |[T3l . 
In this paper, we also prove the stability of any e-approximate Max- Weight under the adversarial model, when 
£ > is small enough. We conclude the paper with a set of simulation results showing stability of Max- Weight on 
adversarial setups. 

A. Discussion 

We now give a high-level description of the Max- Weight algorithm and discuss why the standard stochastic 
analyses are invalid in the adversarial case. Essentially the protocol operates by maintaining at each node v a queue 



3 



of data for each possible destination d. We denote the size of this queue at time t by ^. For any set of edges 
in the network, the total weight on the set at time t is the sum over all edges in the set of the queue differentials 
multiplied by the instantaneous edge rates. (A formal definition will be given in the model section below.) At all 
times the Max-Weight protocol transmits data on edges so as to maximize the total weight that it gains. In many 
situations computing the exact Max-Weight set of transmissions is a computationally hard problem. However, in 
Section 4 we show the stability of an approximate Max- Weight algorithm which can be implemented efficiently in 
many practical setups. 

We say that we are in the stationary stochastic model if there is an underlying stationary Markov Chain whose 
state determines the channel conditions on the edges. We say that we are in the adversarial model if we do not 
make such assumptions. In order to make sure that the network is not inherently overloaded the adversarial model 
assumes that there exists some way to route and schedule the packets so as to keep the network stable. However, 
these routes and schedules are a priori unknown to the algorithm 

Most previous analyses of Max- Weight have been performed in a stationary stochastic model and they take the 
following form. Define a quadratic potential function P{t) = J2v di^i df show, using the assumption that the 
traffic arrivals are within the network stability region, that the potential function always has a negative drift up to 
an additive second order term of P(t + 1) - P{t) = EvM,d + ^id? " EvM,d)^ ^^^'^ <4 = Q^v^d " ^id- 
Moreover, when the potential function become sufficiently large, the negative drift in the first order term is sufficient 
to overcome the positive second order term. Therefore the entire potential function has a negative drift. This 
determines an upper bound on P{t) = J2v d(^l d)^ hence we have an upper bound on J2v d d- 

The reason that this type of analysis does not apply in the adversarial model is that the channel rates associated 
with the large queues in the network may be very small (or even zero). In this case we cannot necessarily say that 
a large queue implies a large drop in the potential. Hence for any possible queue configuration there is always the 
possibility that the potential function P{t) = d(^i,d)'^ increase. Hence we need a different approach to 
ensure stability. We discuss this in more detail in Section 2. 

B. Why do adversarial models make sense 

We now briefly discuss why it is useful to consider the adversarial setting which includes the worst case scenario; 
A model that is governed by a stationary stochastic process is not general enough to cover many widely occuring 
scenarios. For example, consider a cellular network in which a car is driving down a road between evenly spaced 
basestations. In this case the channel conditions between the car and its closest basestation will rise and fall in a 
periodic fashion. Moreover, when a car drives into an area of poor coverage (e.g. a tunnel), the channel rate could 
go to zero. In particular, this could happen in a haphazard manner that is not modeled by a stationary stochastic 
process. 

The situation is even more severe in ad-hoc networks. As nodes move around many of the edges (i, j) will only 
be active for a finite amount of time. Hence any stationary stochastic model that gives a non-zero channel rate to 
such an edge cannot accurately reflect the edge rate over a long time period. However, we still wish to ensure that 
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the queue sizes will not blow up unnecessarily over time and we believe that an adversarial analysis is one way to 
address this type of question. 

In Q, the stability of Max-Weight in some adversarial model was proven. However, it was not sufficiently rich to 
capture many types of wireless interactions. First of all, in the model of |2 | all edge rates were either zero or one. 
Secondly, when a edge had rate one we could transmit on it regardless of what is happening on the other edges. 
However, this model cannot capture a situation in which edge rates are variable, nor can it capture a scenario with 
two interfering edges such that we can transmit on either one in isolation but not both simultaneously. 

In this paper we will define a more general adversarial model in which any interference conditions are possible 
and edge rates can vary over time. This allows us to capture arbitrary types of wireless interference behavior. In 
the next section we describe our model in more detail, after which we present our results. 

C. The Model 

We assume a system in which time is divided into discrete time slots. We consider a queueing model for packet 
transmissions. Let D be the set of possible destinations. Each destination in D can be a subset of the set of nodes. 
At each time step t a set of feasible edge rate vectors R{t) C is given by the adversary where k = \E\, and E 
is the set of all directed edges. Suppose that r{t) G R{t). It means that if we write r{t) = (ri(t), r2(t), . . . , rk{t))^ 
then it is possible to transmit on edge e at rate re{t),for all edges simultaneously. In other words we can transmit 
data of size xi on edge 1, data of size X2 on edge 2, etc., so long as < Xg < re{t) for all e. Note that this means 
that the rates satisfy the downward closed property, i.e., we can always transmit on an edge at a rate that is less 
than the rate re{t). 

This is a very general setting for the interference model because it includes all the possible interference constraints, 
including k-hop interference, independent set constraint, and node exclusive constraints. For example for a dynamic 
network G{V,E{t)), R{t) = {{re{t))eeEit)\re{t) = or 1 for all e G E{t), re^(t)re^(t) = if ei and 62 are 
incident in E{t)} represents a set of feasible edge rate vectors of independent set constraints on E{t) that changes 
over time. 

We make the following assumption about the adversary. (It was shown in f5l that if we do not have these 
conditions then no online protocol can be stable.) 

• All packet arrival and edge rates are bounded from above and non-zero rates are bounded away from zero. In 
other words, there exist values i?min > and i?max > such that for each r{t) = (ri(t), . . . , rk{t)) G R{t), 
re{t) < i^max and if re{t) ^ then re{t) > Rmin- 

We now define the (cj, -adversary. At each time, it determines the packet arrivals and edge capacities. Then, 
the routing and scheduling algorithm decides the packet transfers in the network against the (cj, e) -adversary. In 
this manner, our framework can be understood as a type of sequential game. 

Definition 1: We say that an adversary injecting the packets and controlling the edges is an (cj, -adversary, 
A{uo^e), for some e > and some integer > 1, called a window parameter, if the following holds: The adversary 
defines the feasible rate vectors and packet arrivals in each time step subject to the constraint that there exists a 
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routing and scheduling algorithm T (possibly involving fractional movement of packets) which keeps the system 
stable. Let tp be the time when a packet p is injected. Then we can define = {{e^t')\t' G [tp^tp ^ uj — 
e,t') > 0, where i{p^e^t') is a fractional amount of p that is transmitted by T along e at time t'}, which 
corresponds to the movement of packet p from its source to one of its destinations under the algorithm T. For all 
packet (1 — |) fraction of p will arrive to its destination during the window [tp^tp ^ uj — 1]. For any integer 
j, let P be the set of packets injected during the window Wj = [jo;, (j + — 1]. Then the adversary assumes 
that the following holds 



where r{t^) G R{t^) are edge rate vectors assigned by T. 

This is a very general adversarial model because it covers all the possible interference conditions, including 
k-hop interference, independent set constraint, and node exclusive constraints, in dynamic networks, and this model 
includes adversarial models used in ITJ, HI and I2j|. We prove the following theorem, which shows that the Max- 
Weight protocol is throughput-optimal even against the strongest adversary. 

Theorem 1: The Max-Weight protocol is stable under any A{uj^e) for any e > 0. 

D. The Protocol 

We now define the Max- Weight protocol. We assume that each node v has \D\ queues which correspond to 
each destination, respectively. Thus, we have n\D\ many queues. Let Qv.d be the queue at node v for data having 
destination d. Let ^ be the total size of data in queue Qv,d at time t. We define a general routing and scheduling 
algorithm Max-Weight(/3) that is parameterized by a parameter /3 > 0. We use Max-Weight to denote the 
algorithm with /3 = 1. In this paper, we will use the term scheduling algorithm to mean a combined routing and 
scheduling algorithm. 
Algorithm Max-Weight(/3) 





1) 




is maximized (with an arbitrary tiebreaking rule) where 




Send data of size Se{t) from Qy^d(e) to Qu,d(^) along e. 

2) For each time t, and for each node v, accept all packets injected by the Adversary to v. 

3) Remove all packets that arrive at their destination. 



When /3 > 0, (g^ ^^ce))^ — (^^ — ^ implies ^(g) — ^^^^ > 0, so it guarantees all packet movement 



between queues occur from a taller queue to a smaller queue. 



In fact, for any (1 — 6) fraction of p with constant < 5 < £ all the results in this paper holds. 
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The algorithm can be understood to be designed so that the following potential function decreases as much as 
possible. (However, as discussed earlier and unlike in the stochastic case, there is no simple argument that for 
sufficiently large queue sizes there always is a decrease in potential.) 

v,d 

II. Stochastic analysis 

In this section we give more details of the typical stochastic analysis and explain why this type of analysis does 
not directly hold in the adversarial setting. We say that we are in the stationary stochastic model if there is an 
underlying stationary Markov Chain M with state space {m^} and a function /(•) from {m^} to sets of feasible 
edge rate vectors R{t) such that the Markov Chain updates its state at each time step and if it has state {m^} at 
time t then R{t) = f{mr). 

Throughout this section we will focus on the case that (3 = 1 and study the potential function P{t) = di^l d)'^- 
Let al ^ (resp. ^) be the amount of data arriving into (resp. departing from) Qy^d at time t, according to the 
Max-Weight algorithm. For simphcity we shall also discuss the most basic scenario in which the distribution 
over feasible service rate vectors is i.i.d. at each time step. Let a'l ^ ^'l,d the corresponding quantities for 
the underlying "optimum" schedule (that keeps the system stable by assumption). The expected change in P(-) 
from time step t to time t + 1 is given by, 

E[P{t + 1) - P{t)] = E[Y^{ql+^f - 

v^d v,d 

= s[E('/M+<d-0)'-E«d)'] 

v,d v,d 

v,d v,d 

< E[^{2ql,{a'l^, - b'l,) + (4,<i - bl,)% (1) 

v,d 

The final inequality is due to the definition of Max- Weight since we can think of Max- Weight as always making 
the decision that minimizes J2v d ^i,di^'i,d~^'i,d)' taking into account the i.i.d. nature of the service rate vectors 
and the fact that the traffic injections can be scheduled by the optimal algorithm, we have that E[{a'^^ d~^'vd)] ^ ~^ 
for all V, d. since there is an upper bound on the amount of data that can be transfered between two queues at each 
time step, E[{al d~K d)^] bounded by some quantity C that is independent of time. Hence, 

E[P{t+l)-P{t)]<C-2Y,qid^ 

v,d 

and thus if there is some Qy^d that satisfies ^ > C/2£ then the expected drift of P{t) is negative at time t. This 
in turn implies that P{t) cannot grow indefinitely over time and so the system is stable. 

We can now demonstrate why this type of argument does not hold in the adversarial model. In a non- stationary, 
adversarial environment it is not necessarily the case that the set R{t) and packet arrival rates are independent of 
the ql ^ values. That is, we cannot assume that a large queue will have good connectivity to the rest of work, so 
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there is no analogue of the statement that E[{a'\ ^ — b'l ^)] < —£. In particular, it may be the case that for all 
large ql ^ and for all r{t) G R{t), the value of re{t) is zero for all edges e that are adjacent to node v. Indeed, 
the fact that we have built up a large queue in one region of the network may be precisely because that region has 
poor connectivity to other parts of the network. Hence we need a different type of argument to show stability in 
the adversarial setting and this is the question that we address in this paper. 

III. Main Results 

At the highest level, our proof proceeds as follows. We first show a result that bears some similarity to the 
"negative drift" result that is used to prove stability in stationary stochastic systems. In particular in Theorem [2] we 
show that whenever a packet is injected, we can assign a set of transmissions by the Max-Weight(/3) protocol to 
the packet such that the resulting decrease in potential almost matches the increase in potential that arises from the 
packet injection itself. This allows us to bound the increase in potential whenever a packet is injected. (We note as 
an aside that when there are no packet injections the Max-Weight(/3) protocol ensures that the potential never 
increases.) Moreover, Theorem [2] also shows that whenever there is an injection to a queue that is sufficiently tall, 
the assigned transmissions induce a decrease in potential more than the increase due to the packet injection. Hence 
for such injections there will always be a decrease in potential. 

However, in an adversarial system this type of argument is not sufficient to show stability since it might be 
the case that most packets are injected into small queues. We therefore extend the proof of Theorem |2] to a more 
general result that will ensure stability. In particular we introduce the notion of a bad injection. This is an injection 
that is extra to the injections that are allowed by our definition of adversary. This notion is convenient since we 
will use an inductive proof in which injections to small queues that lead to a big increase in potential are treated 
as "extra" packets by the inductive hypothesis. In particular, we are able to use an inductive argument to show that 
the number of bad injections is bounded, and hence we can obtain an upper bound of the potential over all time. 
This immediately impHes the stability of Max-Weight(/3). 

We now describe these ideas in a little more detail. The procedure in our setup is as follows. At each time, 
an adversary chooses the packet injections and interference conditions. Then Max-Weight(/3) determines the 
(routing and) scheduling of packet transmissions. To show the stability of Max-Weight(/3), we will define an 
assignment of each packet with a set of (partial) transmissions in the network, so that any injected packet to a tall 
queue will decrease the potential function. 

Definition 2: We imagine that there are \D\ links on each directed edge corresponding to each possible destination 
respectively. Let L = {i = {e^d)\e = (v, u) e E^d e D} be the set of all links. Let p be a packet injected at time t, 
and IctW = [t^t-\-uj — 1]. A set of partial transmissions Tp assigned to p is defined as a vector of dimension c^lLl. 
Let Se{t') be the vector chosen by Max-Weight(/3) that maximizes Y.e^e{t') ({Qy d(-)^^ ~ (^ndC-))^) • ^ 
given adversary A{uj^e), and a scheduling algorithm Alg, let Tp{A{uj^e)^ Alg) = {sp/{t'))£^L,t'ew be a vector of 
size c^lLl that satisfies for each e e E, d e D, t' e W, (i) Sp^^e^d){t') ^ 0^ ^nd (ii) d^p,{e,d){t') ^ Se{t'). We 
say rp{A{uj^e), Alg) is a set of (possibly partial) transmissions assigned with p, for convenience, denote by Tp. 
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Packet 




h = ((^3 , v^), v^) 



Fig. 1. An example of partial transmission assignment. Suppose that a packet pi is injected to a node vi at time tp^, and its destination is 
V4. For instance, a set of partial transmissions assigned with pi that contains Spi,£i(^pi + 2) = 0.5 and Sp^^£^(tp^ — 1) = 1 can be Tp. 
Note that the assignments do not need to be at the same time, and the whole assignments do not need to form a path, or multiple paths. 



We note that the word partial is used to reflect the fact that one transmission may correspond to multiple packets 
p subject to the condition (ii). Conceptually, it allows the case that an injected packet can be transmitted to its 
destination across multiple paths. Thus, an assignment of partial transmissions Tp of each packet can represent 
many general routing patterns. Moreover, it allows the case when Tp does not form a set of paths. An example of 
this assignment is shown in Fig 1. 

Theorem 2: Consider a given adversary A{uj^ e) for any uj > 1 and e > 0, and the Max-Weight(/3) protocol 
for some /3 > 0. For any injected packet p, we can assign this packet with Tp = rp{A{uj^ e), Max-Weight(/3)) 
so that the sum of total potential changes is less than —j^j2^p{P + 1)^^ + ^pO{q^~^), where q is the height of 
the queue where the packet is injected. Therefore, there is a constant q* depending on uj and e, so that if g > 
the sum of potential changes due to the injection is less than —^£pq^. 

In the next section we will prove the stability of the MAX- WEIGHT protocol under any A^u^e). The same 
argument can be applied to prove that the Max-Weight(/3) protocol with any constant /3 > is stable under any 
A{uj,e) with s > 0. 

Now, we will prove the stability of the MAX- WEIGHT protocol under any A{uj^e). The same argument can be 
applied to prove that the Max-Weight(/3) protocol with any constant /3 > is stable under any A(cj, e) with 
s>0. 

We define a more general adversarial model, which we call a general adversarial queue system with bad packets. 
In this model the number of queues can be any finite number, not only of the form n\D\. An adversary allowing 
h many bad packets is defined as follows. 

By Theorem |2] for any A{uj^ e) under Max-Weight, for each injection of packet p, we can assign this packet 
with a set of partial transmissions Tp so that the sum of potential changes due to these movements are at most 
— Y^j2^pq + C', where q is the height of the queue where the packet is injected and C is a constant depending on 
UJ and e (but not on n and t). In a general adversarial queueing system, we also consider the same assignment Tp. 
If the sum of potential changes due to Tp is at least —j^^^pq + C + 1, we now say this a bad packet. We say 
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all the other injected packets are good packets. 

Definition 3: We say that an adversary injecting the packets and controlling edge capacities in a general adver- 
sarial queue system is an A(cj,e,6) for some e > and some integers uj > 1 and 6 > 0, if the following holds: 
there exists a scheduling algorithm Alg and an assignment of partial transmissions for each injected packet p (for 
example, the collection of Tp for Max-Weight protocol), such that among all the packets injected over all time, 
there are at most b bad packets. 

In the proof of MAX- WEIGHT stability, we will use an induction on the number of queues. For a given subset 
of queues, we can imagine a smaller (sub-)system of those queues. For an injected packet p, if too much of the 
assigned partial transmissions do not occur between the queues of the sub-system, we will consider p as a bad 
packet. In the analysis, we will use the following property of good packets. 

Lemma 3: Consider a general adversarial queue system A{uj^e,b) with a corresponding scheduling algorithm 
Alg and a corresponding set of partial transmissions of packets F. Then there is a constant depending on uj and 
£, so that for any good packet p injected to a queue of height if g > the sum of the decrease of potential due 
p is more than f^^g. 

Proof: From the definition, the sum of potential changes due to the injection of any good packet p is at 
"^^st -Y^^p(l + + 1. Let q* = (2^^%;) + 1)' ^^en for any q > q\ y^^p^ " ¥p^ = ^i^^p^ 
— '^4- 2s ^P^* = C -\- 1. Thus, the decrease of potential is more than ^£pq for q> q*. ■ 
The crux of our analysis will involve proving the following results (in section 4.2). 

Theorem 4: Consider any general adversarial queue system A{uj^e^b) for any constant £ > with corresponding 
scheduling algorithm Alg. If Alg guarantees all packet movement between queues occurs from a taller queue to a 
smaller queue, then Alg is stable. 

Hence from Theorem |4] we obtain Theorem [T] directly. 

IV. Proofs of Theorems 

A. Proof of Theorem |2] 

Proof: We divide time into windows of u time steps, [0,a; — 1], [a;,2cj — 1], [2a;, 3a; — 1], — Since Wj = 
[jcj, (j + l)a; — 1] for all integer j > 0, the collection of Wj for j > is non-overlapped and the union of this 
collection covers all time slots t. From now on let W = Wj for some integer j > 0. 

For each time G W, and for each node v, we accept all packets injected by the adversary. For each packet 
p e P U we will associate some fraction = {dp^e{t^)\{e,t^) G of rates of directed edges used in 
as follows. Let Pi^ . • .Pm be all the packets injected in P U The order of p^'s can be any possible ordering. 
Then from the definition 1, 

^ £fe,e,t')<(l-£) E ^e°HO- (2) 

where A^\t) G R(t) are edge rate vectors assigned by T. 
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First, for pi and for each directed edge e used in ^p^, we can define dp^^e{t') for each t' that 

< dp,^e{t') < re{t') and (1 - ^ dp,^e{t') = ^ ^{pi,e,t'). (3) 

We define dp^^eij^') = for all directed edge e which is not used in ^p^. Then, from ^ and ([sj, for each e G £^ 

and t' e W, let r^^^(tO = re{t') - dp^^e{t')- Then we have, 

m 

Similarly for p2 and for each e used in "^p^ we can define dp^^e{t') for each G 1^ so that 

< dp,^e{t') < ri'\t') and (1 - e) ^ ^p„e(tO = E ^(^2,6,^0- 

few few 

By continuing this process, we can define dp.^e{t') inductively for all i >2, for each e used in and t' e W 
so that 

< dp^^eit') < r^t^\t') and (1 - ^ ^/p„e(tO = ^ ^{p^.e,t'). (4) 

At time t^ think of a directed edge e = (v, u) ^ di link (e, d), and suppose that e has rate Veit') at time 
and ql ^ > ql^ ^ -\- re{t'). Then the potential change Ce{t') due to transmission via a link (e, at time t' is 

= re(i')(/? + 1) {{^UY - i^UY) + re(i')0 {{qiaf-' + (<,)''-^) • (5) 

Note that this is also true when \qu(i~^v d\ ^ ^e(^0- Hence, when dp^e{t') amount of edge rate of e at time t' is as- 
signed to an injected packet p, we can consider dp,e(tO(/3+l) ((^^' - {qidf)^dp^e{t')0 ((^^' J^"^ + (^m)^"^ 
amount of potential change is induced by a packet p. 

We consider the sum of potential changes at each time t' by Max-Weight(/3). Let Se{t') be a vector chosen 
by Max-Weight(/3). From ([5]), 

Ceit') > S^im + 1) - (<,(e))^) - i^„.axO ((<,(e))^-' + (<.(e))^-') . (6) 

From ([6]), we obtain that 

E ^e(i') > E ^e(*')(/5 + 1) - (<,(e))'') - i?maxO + (^.(e,)''-') • (7) 

eeE eeE 

Thus, if we fix the time t' , then the sum of potential changes at t' by Max-Weight(/3) is less than or equal 
to the sum of potential changes at t' by dp^e{t')- We want to define so that the sum of potential changes by 
Sp,{e,d){t^) is equal to the sum of potential changes by dp^e{t^)- 

Firstly, we fix G W. Let pi, . . . ,Pm be the packets injected in . Let E = {ei, . . . , e/c}. The order of e^'s 
can be any possible ordering. For each ej G E, let 
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where di is the destination of Pi. Let 



where ej = (vj^uj). At first, we define 



if Sei(t') > 0, and Spi,(ei,(/i)(*') = otherwise. Since Sei(i') is chosen by Max-Weight(/3), Spj_(ei,di)(^') > 0. 
Next, let = se,(f)-sp„(e.,<i.)(i'), ^^'H^') = J(i')-Sp„(e„<i,)(i') {(Cci^ - (CJ^) . and ifiP(t') = 

(i')-V,(e.,rf.)(i') («,<ij''-«,<i.)'')- 



Similary, for all 2 < i < m, we can define 

if 4r'\*') > 0, and Sp^,(e„d.)(f ) = otherwise. Let si\\t') = s^'^^t') - Sp^,(e„d.)(f ), J^'Ht') = j('-^\t') - 

SpM)it') {iCdf - (iLdf) ' and K^(t') = Kt'\t') - sp..(e..*)(t') (iCf - iCdf) ■ 
Now, from ([T]), we can define inductively Sp.^(^e.^di) for all j = 2, . . . , /c, and z = 2, . . . , m, so that 



(12) 



if si* > 0, and Spi,(ej,di)(*') = otherwise, where ej = {vj,Uj), and is the destination of pi. 

Let Fp = (sp._(ej,(/.)(t'))eje£;,t'evy. where di is the destination of pi. for each G J^. We obtain that 

Sp,(e,rf)(i') > 0, Ep,dSp,(e,rf)(^') < Se{t'), 



k m 



i=l i=l 



EE«P..(e.A)(*')((<.,<i.)''-(<,rfJ'') < ^(0 



and also the followings holds. 

km k 

EE^f..(e.A)(0((<A)''-(<A)'') = E^«.(^') 

j=l i=l j=l 

k m 



= EE^P.e,(0((<.A)^-(<A)^)- (14) 
j=l i=l 

In the previous assignment, we first defined Sp^^^^.^di) for j = From (13) and (14), Max-Weight 
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algorithm guarantees that the following inequalities hold. 

k 



j=i j=i i=i 

k m 

j=i i=i 

^ E«e,(t') (15) 

Thus, we can assign s^,,(ei,d,)(^0 for i = 1, . . . , m, so that ^"^l^ 5^,,(ei,d,)(^o - (^ni,d,)^) = ^e^it'). 

Similary, for all j > 2, we can assign Sp.,(e^.,d.)(t/) for z = 1, . . . , m, so that Elli <5pi,(e,,(iO(^0 ((^C^.)^ 
~i^Uj4i)^) ~ ^ej{t')- Then by taking the sum of the above inequalHties we derive that strictly equallity holds 
in (14). So Tp is well-defined by the (e,d) values. Thus we assigned all packet p G with Tp so that the 
assigned amount of partial packet transmissions in each link at time t' is less than or equal to the amount of packet 
transmissions of M AX- WEIGHT in each link at time t' . 

The proof that for any A{uj^ e) under Max-Weight(/3) , for each injection of a packet the sum of potential 
changes due to the injection of p and Vp is at most — Y^^^p{l^ + 1)^^ ^pO{q^~^)^ where q is the height of the 
queue where the packet is injected, is in the Appendix A. ■ 

B. Proof of Theorem [?| 

Proof: Let £ > and let > 1 be some integer. Consider a general adversarial queue system A{uj^e^h) with 
scheduling algorithm Alg. Let n be the number of queues in this system. We will show that there is a constant 
U (n, g'o, ^) such that for A{(jJ^ e, 6), when the size of the tallest queue at time t = is at most go, the sizes of all 
queues over alH > is bounded above by U (n, qo^h). 

We induct on n to show that for any go > and 6 > 0, there exists U (n, qQ^h). For the basic step, when n = 1, 
there is only one queue in the system, and thus it should be a destination queue. Hence, /7(n, go, ^) exists. 

For the inductive step, we assume that there is U{m,qo^b) for all 1 < m < n — 1, and for all go ^ and 
b >0. Using this induction hypothesis, we will show that for any go, /7(n, go, 0) exists. We can set /7(n, go, 1) = 
/7(n, [/(n, go, 0) + i^max, 0), because at each time when the bad packet arrives, the size of the tallest queue is at 
most U (n, go, 0) and we can transmit data of size at most i^max on each link. Similarly for any i > 1, we can set 

U{n,qo,i) = U{n,U{n, qo,i - 1) + i^max,0) (16) 

by considering the time when the zth bad packet arrives. Now we only need to prove that /7(n, go,0) exists. 
Let P{t) be the potential of the queues at time t. Note that each injection to a queue of size at most g* makes 
the potential increase by at most (2i?max^* + ^max)- Theorem [2j the maximum possible increase of potential 
induced by all injections during any time window of size uj is bounded by some constant Pq. Now, for fixed n, we 
define the following; Let Mn = 0. Given M/^+i, for j = 1, 2, . . . , /c, define 



A 2(n - k)S] 
Lj — . 



A Lk 2Pn 



Then M^, /c = 1, 2, . . . , n, are decreasing over /c (Mi M2 . . . = 0). We will show that for any 

A(cj,e, 0) for a general adversarial queue system with n queues, for all time t > 0, P{t) is bounded by some 
value that is independent of t. More precisely we will show that 

P{t) <{n- 1)M^ + ms.x{nqlnM^ + 2V^R^,^M^ + i^^xl- (17) 



Note that the right-hand side of (17) is independent of t, so we can conclude that U{n^qo^O) exists. 

Now suppose that we are given a general adversarial queue system with n queues controlled by an A(co', e, 0) 
and some given scheduling algorithm Alg and a corresponding set F of partial transmissions assigned with packets 
, such that all the initial queue sizes are at most qo. 

Suppose that for all time t, P{t) < nMl holds. Then it implies that the given scheduling algorithm Alg is stable 



and (17) is satisfied. Now suppose that there is to such that P(to) > nMf. By choosing the smallest such to, we 
may assume that P(to) ^ max{ngQ,nMf + 2^/nRmaxMl + ^maxl since if P{to — 1) < nMf, the change of 
potential between time to — 1 and to is at most + i^max- Note that if P{to) > nM^, then there is a 

queue of size at least Mi, so the size of tallest queue at that time is at least Mi. 

Let qi > q2 > ... > = be the ordered sizes of the queues at time to. For 1 < j < n, let Qj be 
the corresponding jth tallest queue at time to. Then since qi > Mi and qn = Mn = 0, there exists some 
1 < k < {n — 1) such that qk > M^ and qk-\-i < M^+i. Hence, qk ^ qk-\-i and the sizes of the small queues stay 
much smaller than q^, and so the sizes of the tall queues are much bigger than those of the small queues. We will 
show that for all the time afterward the size of the (/c + l)th tallest queue stays much smaller than Mj.. A precise 
description will appear later. 

Now fix one such k. We will say all the queues having size at least at time to are ''tall queues'', and all 
the other queues ''small queues". Recall that by our assumption on the MAX- WEIGHT protocol, data from a small 
queue will never move to a tall queue. Hence we can consider the set of all the small queues as a separate general 
adversarial queue system. We will call this queue system a system of small queues. Afterward, we will use an 
inductive argument on this system of small queues to guarantee that their sizes are bounded by a constant Sj for 
some 1 < j < k during some period of time. 

Let ti be the first time after to such that there is an injection of a packet to a tall queue or a transmission of 
a packet from a tall queue to a small queue. Here we note that in the case when there is no such ti > to, then 
for this A(co',e,0), the argument that will be presented in the proof of Lemma [s] shows that the sizes of all the 
small queues cannot be bigger than Mj. for any time t > to. Since a packet in a small queue will never move to a 
tall queue , the potential of tall queues are non-increasing over all time. Hence we obtain that P(t) is bounded by 



(n - 1)M| + P(to) < (n - l)Mf + maxjngg, nMf + + i^^axl ^r all t > to as required in ( 17). 
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-Mk 
- Mk+i 



Tall queues Small queues 

(of sizes qi,...qk, resp.) (of sizes qk+i,...,qn, resp.) 



Fig. 2. All the queues having size at least at time to are called ''tall queues'' and all the other queues are called ''small queues''. Then, 
tall queues are much higher than small queues. 



When there is such a ti, our main argument is that during time to < t < ti, the system of small queues is 
maintained. By Lemma |3j we are able to show a net decrease in the potential in the system, as long as there are 
"sufficient" injection into queues that are large enough. Hence, one injection to a tall queue or one transmission of 
a packet from a tall queue to a small queue creates a sufficient decrease in potential. We can therefore show that 
the potential remains bounded as long as the increase in potential between times to and ti is less than the decrease 
in potential due to the injection or transmission at time t\. We will prove the following Lemma. 

Lemma 5: There is T, satisfying to < T < ti + - 1, such that P(t*) < P(to), and during to < t < t* the 
sizes of small queues are bounded by M^. 

The proof of Lemma |5] will appear later after we conclude the proof of Theorem |4] By applying this, the 
potential of all the small queues, Ps{t) = X]r=fc+i(^i)^' bounded above by (n — 1)M| < {n — l)Mf since 
the sizes of all the small queues cannot be bigger than Mj^ for any time to < t < t* — 1. Note also that until 
the time t* — 1, the potential of all the tall queues, Prit) = Xli=i(^i)^5 non-increasing over time. Since 
at time t* we know that the total potential P(t*) < P(to), for to < t < t*, the potential P(t) is bounded by 
(n - l)Mf + maxjngQ, nMf + 2y^i?max^i + ^maxl choose the first time t > t*, if there exists such 

t, so that P(t) > nMf , and set this time as a new to. Then by applying the same argument, we obtain that for all 
time t > 0, (17) holds. Hence U{n,qo^O) exists. It implies (16) which in turn proves Theorem |4] ■ 
Proof: (Proof of Lemma |5]) Note that, for all time to < t < ti, there may be some injection of packets to 
a small queue so that its corresponding set of partial transmissions includes some links between tall queues that 
yields the amount of potential change at least 1. We will regard these kinds of injected packets as "bad packets" 
for the system of small queues, and we will call these injections "bad injections". That is, each bad injection in the 
system of small queues makes potential change among tall queues at least 1 . Note that by considering these packets 
as bad packets, the dynamics of small queues can be thought as an independent general adversarial queue system 
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having n — k queues, which means that it is a kind of subsystem of the original system. Then essentially, we will 
show that the total amount of these bad injections over all time to < t < ti is bounded by some number which is 
independent of t. Note that each bad injection in the system of small queues makes potential change among tall 
queues at least 1. 

Now consider all possible cases to obtain the required t*. At first, we consider the case; (Case I) if there is 
no bad injection to small queues for all time to < t < ti, (Case II) if there are some bad injections in that time 
window. 

From the definition of the Max-Weight(/3) algorithm, re{t) > Rmin for each link (e, d) such that ^—ql d — ^^ 
so we send data along e at least i^min at once if we can. Without loss of generality, we can assume that i^min and 
i?max satisfy Rmin <^p< ^max for cach pe I^. 

— Case I If there is no bad injection to small queues for all time to < t < ti, then by the induction hypothesis, 
for all to < t < ti, the sizes of small queues are bounded above by Si = U{n — /c, M^+i, 0). Thus, the potential 
of all the small queues at time ti is at most |Li = {n — k)S\. By Lemma [sj the decrease of potential due to a 
injection to a tall queue is at least ^RminMk, and the decrease of potential due to a transmission from a tall queue 
to a small queue at time ti is at least {(Mfc)^ - (Si)'^} - {{Mj, - i^min)^ - (^i + ^min)^} = 2Rm\n{Mk - Si). 
Thus, the decrease of potential due to a injection to a tall queue or the decrease of potential due to a transmission 
from a tall queue to a small queue at time ti is at least mm{|i?min^fe, 2i?min(^/c ~ > |i^min(^fe — Si). 
Note that from the definition of M^, 

^Rmin{Mk-Si) > |Li+Po. 

Therefore, the decrease of potential due to an injection to a tall queue or a transmission from a tall queue to a 
small queue at time ti is more than or equal to the potential of all the small queues at time ti, and the difference 
among them is at least Pq. Note also that the maximum possible increase of the potential induced by injections 
during the time [ti^ti -\- uj — 1] is bounded by Po, and that all the packet movement associated with the injection 
to a tall queue at time ti occurs in this time window of size uj. Since there was no injection to any of the tall 
queues during to < t < (ti — 1), the potential of the tall queues is non-increasing for to < t < ti. Hence, by letting 
r = ti + - 1, we have P(r) < P{to). 

— Case II Suppose that there are some bad injections to small queues. Let < ri < r2 < . . . < Vk-i be the 
ordered list of {qi — ^2), {Q2 — Qs)^ • • • , {Qk-i — Qk)- As {Mi, M2, • • • } is a set of queue thresholds, {Li, L2, • • • } 
defines a set of thresholds for the above list of queue differences and {Si, S2r ' '} gives a bound on the sizes of 
the small queues during some period of time in the following cases. Note that these numbers are independent of t. 
We can divide (Case II) by following three cases; (Case II- A): if ri > Pi, (Case II-B): if there isl<m<k — 1 
such that for all I < j < m, rj < Lj, and rm+i > Pm+i, (Case II-C): if rm < Pm for all 1 < m < A: — 1. 

— Case II-A Suppose that ri > Pi. Then any transmission between two tall queues at some time to < t < ti 
will make the decrease of potential more than Pi. Let be the smallest time t* > to so that there is a transmission 
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between two tall queues at time t*. By the induction hypothesis, for all time to <t<t'^, the sizes of the small queues 



Then from the same argument as the (Case I), P(t*) < P{to). 

— Case II-B Suppose that there isl<m<k — l such that for all 1 < j < m, rj < Lj, and r^+i > Lm-\-i- We 
will show that the potential of all the small queues is bounded by We may assume that bad injections to 

small queues induce transmissions just between neighboring tall queues. Note also that the amount of bad injections 
to small queues during some period of time is bounded by the total amount of transmissions between tall queues 
during that period of time. 

We say a link ej = (Qj, Qj+i) between two neighboring tall queues is a tall link if qj — qj-\-i > Lm+i and a 
small link otherwise. We can divide (Case II-B) by following two cases; (Case II-B-1) if there is no transmission 
via tall links for all time to < t < ti, (Case II-B-2) if there is a transmission via some tall link for some time 
^0 < t < ti. We will use the following Lemma. 

Lemma 6: Let ri, r2, . . . , be the sizes of the small links at time to and assume that rj < Lj for all 1 < j < m. 
If there is no transmission via tall links for to < t < t' and all the transmissions occur via small links, then the 
total amount of packet transnussions via small links during that period of time is bounded by 



Proof: Let ej^^ej^, . . . ej^ be the set of small links, where ji < j2 < • • • < jm- For 1 < i < m, let Si be 
(Qji - Qji+i)' Hence {si}i<i<m is a permutation of {rj 

l<i<m' 

Recall that the sizes of the queues at time to are non-increasing with respect to their indices. Moreover, note that 
if j^+i — ji > 2 for some i, then any packet p that was originally located at Qm, with m < ji -\- 1 cannot move 
to for all time to < t < f. Hence we can consider each subset of consecutive small links separately. For 

example if ji, . . . ,jm are 2,3,5,6,7, then we will consider 2,3 and 5,6,7 separately. Suppose that ji, j2 • • • , js are 
consecutive integers. Since + . . . + _ = + . . . + , we obtain that 



are bounded by Si = U{n — Mj^+i, 0), and the potential of the small queues is bounded by |Li = (n — k)Si. 



Ill' / III' ^ ^ ^ ^ X 9 

Y(ri+r2 + ... + r^)^ < -(Li + L2 . . . + L^)^ 




Thus, the amount of packet transmission via ej. 



'ii 5 • • • 5 ^js 



IS 




] 



2 




17 

A similar argument holds for other consecutive indices, separately. Hence the sum of total amount of transmissions 
via small links during time to < t < is bounded by ^(^i + ^2 + • • • + ^m)^- ■ 

— Case II-B-1 If there is no transmissions via tall links for all time to <t<ti. Then by Lemma [6j the total 
amount of bad injections to the small queues during to < t < ti is bounded by ^ (^1 +i^2 + • • • +^m)^- Since each 
bad injection in the system of small queues makes potential change among tall queues at least 1, we conclude that 
the number of bad packets to the system of small queues is also at most by ^(^i + ^2 + • • • + ^m)^- Therefore, 
for all time to < t < ti, the sizes of the small queues are bounded by 

5'm+i = u(n-k, M/e+i, y (Li + L2 + . . . + Lm)^^ 

by the induction hypothesis. Hence, the potential of all the small queues at time ti is at most |Lm+i = {n—k)S^_^i. 

Note that the potential for the tall queues is non-increasing for to < t < ti. By Lemma [3] the decrease in 
potential due to an injection to a tall queue is at least fi^min^fe, and the decrease in potential due to a transmission 
from a tall queue to a small queue at time ti is at least 2i?min(^fe — ^m+i)- Thus, the decrease of potential due 
to an injection to a tall queue or the decrease of potential due to a transmission from a tall queue to a small queue 
at time ti is at least mm{|i?min^/c, 2i?min(^/c — ^m+i)} ^ |^min(^/c — 5'm+i)- Note that from the definition 
of Mfc, 

£ £ 
-Rmin{Mk — Sm-\-l) ^ "^m+l + ^0- 

Therefore, the decrease of the potential at time ti is more than or equal to the potential of all the small queues at 
ti, and the difference among them is at least Pq. By letting = ti + — 1, we have P(t*) < P{to). 

— Case n-B-2 If there is a transmission via some tall link for some time to < t < ti, let be the smallest such 
t. Then similarly, by Lemma |6] the total amount of bad injections to the small queues during to < t < t* is bounded 
by +^2 + • • '-\-Lm)'^- Hence the sizes of the small queues during this time interval are bounded by Sm-\-i by 
the induction hypothesis and from the definition of ti, so the potential of all the small queues at time t* is at most 

= {n — k)S^_^i. Moreover, during to <t<t*, for any tall link ej = (Qj, Q^+i), qj is non-decreasing and 
Qj-^i is non-increasing, because any transmission via small links can make qj bigger (when ej-i is a small link), 
or Qj^^i smaller (when e^+i is a small link), but it cannot increase qj — ^j+i. Thus, qj — qj-^i > Lm+i dXt = t* . 
Hence, a transmission via a tall link at time t* will make the potential decrease by at least which is more 

than the potential of all the small queues at time t*. Note also that the potential for the tall queues is non-increasing 
for to<t< r. Hence, we have P(r) < P{to). 

— Case II-C Finally, consider the case when Vm < Lm for all 1 < m < /c — 1. Then by Lemma |6] and the 
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induction hypothesis, for all time to <t<ti, the sizes of small queues are bounded by 

Hence, the potential of all the small queues at time ti is at most = {n — k)Sl. By Lemma [s] the decrease 
of the potential due to an injection to a tall queue is at least ^RminMk, and the decrease of the potential due to a 
transmission from a tall queue to a small queue at time ti is at least 2R^i^{Mk — Sk)- Thus, the decrease of the 
potential due to a injection to a tall queue or the decrease of the potential due to a transmission from a tall queue 
to a small queue at time ti is at least min{^RminMk^2Rmin{Mk — Sk)} > |^min(^/c — Sk)- Then, from the 
definition of M^, |i?min(^/e — Sk) = -\- Pq^ which is more than the potential of all the small queues at time 
ti, and the difference among them is at least Pq- Note also that the potential of the tall queues is non-increasing 
for to<t< ti. Hence, by letting T = ti + - 1, we have P(r) < P(to). 

Hence in all the cases, we have P{t*) < P{to) and for to < t < t*, the sizes of small queues are bounded by 
Sj + ojuR^g^x for some I < j < k, so they are bounded by Mk. ■ 

V. Characterization of the queue sizes 

We now consider the behavior of the queue sizes under the adversarial model. In the case of a stationary stochastic 
network, the typical "negative drift" argument that we described earlier essentially shows that the potential in the 
system cannot grow much larger than (/c^6:~^(i?max)^)^. More precisely, if the potential ever does get larger than 
that amount then some queue size must be larger than k'^e~^{Rmax)'^ • At that point the expression for the change in 
network potential implies the expected drift in potential is non-positive. One consequence of this is that whenever 
an individual queue size becomes larger than (/c^£~^(i^max)^)^ the expected drift in potential is non-positive. 

In contrast, for the Max-Weight protocol in the adversarial model the bound on queue size implied by the 
analysis of Section 4 is actually exponential in the number of users. We now briefly show that this is necessary. In 
particular, we present an example where the Max-Weight protocol does indeed give rise to exponentially- sized 
queues. Our example is close to an example given in |6| in which it was shown that we can get exponential queue 
sizes in a critically loaded scenario (i.e. where e = 0). We now show that this is actually possible in a subcritically 
loaded example (with e > 0). 

We consider a set of N single hop edges (numbered 0, . . . , — 1) that are all mutually interfering, i.e. only 
one edge can transmit data at a time. Let ai{t) be the amount of data injected for edge i at time t and let ri{t) 
be the edge rate. The adversary defines these quantities in the following simple manner. At any given time t let 

= mm{i : qi{t) < (1 — ^)2*}. If = then the adversary sets ro{t) = 1 and ao = 1 — If > then it sets 
ri/_i(t) = 1 — 6:, ri'{t) = and ai'{t) = '^"^"^^ . In both cases all other ri{t) and ai{t) values are set to 0. It is 
clear that these definitions are consistent with an A{l^e) adversary. 

Lemma 7: With the above patterns of data arrivals and edge rates, for each t and for each i, there exists dit' >t 
such that qi(t') > (I - e)2\ 
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Proof: We prove the above statement by induction on i. Suppose that qQ{t) < 1 — e. Then for this time step 
i' is set to and so ao(t) = 1 — e. Once data has been served for edge and the arriving data has been added 
to the edge's queue we have q^it ^1) >1 — e. (Note that this assumes that data arrives in a queue after data has 
been served. This is a reasonable assumption but if it does not hold then we can simply set > 2 and have all the 
arrivals in a window of length uj arrive at the beginning of the window.) This completes the base case. 

For the inductive step, suppose that qi{t) < (1 — e)2'^ for an i > 0. The inductive hypothesis implies that there 
exists some time t' >t dX which i' = i. Suppose that t' is the first such time step. Between t and t' note that we 
must have i' < i and so the value of qi does not change. When we reach time step t' it must be the case that 
qi{t') < 2qi-i{t'). Moreover, by the definition of the edge rates ri-i{t') = 1 — e and ri{t') = Hence the 
Max-Weight protocol serves queue i — 1 but the arrivals are for queue i. Hence qi{t^) is strictly greater than 
qi{t). By repeating this process we eventually reach a time t'' at which qi{t'') > {1 — e)2\ 

By the inductive hypothesis there must be a time t'" > t" for which qj{t"') > {1 — £)2^ for all j < i — 1. 
Between times t^^ and t^^^ the value of qi cannot decrease. Hence at time t^^^ we have qj{t"') > {1 — e)2^ for all 
j <i. The inductive step is complete. ■ 

Corollary 8: There exists a network configuration with N edges and an e) adversary such that some queue 
grows to size (1 — e)2^~'^. 

We remark in conclusion that with a different protocol adversarial models do not necessarily lead to exponentially 
large queues. In (61 another protocol was presented (which directly keeps track of the past history of edge rates 
and arrivals) which ensures a maximum queue size of 0{ujk\1Z\'^Rmax), where IZ is the set of feasible rate values. 
However, we still feel that it is of interest to study the performance and stability of the Max-Weight protocol 
in adversarial networks since it is extremely simple to implement and it has been proposed so many times in the 
literature as a solution to the scheduling problem in wireless networks. 

VI. Stability of Approximate Max - weight 

As remarked in the introduction, computing the exact Max- Weight set of feasible transmissions is in general an 
NP-hard problem. Hence a natural question to ask is what can be achieved if at each time step we only find an 
approximate Max-Weight set of feasible transmissions. In this section we address this question. 

Recall that ^(co', e) assures that there is a set of fractional movement of packets for each p G and there 
is a edge rate vector rg G R{t) for each t G W, so that each edge is used at most {I — e) times of the sum of rates 
associated at e during the time window W. Thus, it guarantees that each edge e can transmit more data than is 
actually required by a factor. Hence, the actual packet movement by Max-Weight induces potential changes 
that are times greater than necessary. 

For an optimization problem, an ^-approximation algorithm is an algorithm that provides an approximate solution 
within (lie) factor of the optimal solution. Although computing the optimal solution of MAX- WEIGHT is 
computationally very hard, in many practical wireless networks ^-approximate solution for r{t) can be computed 
in polynomial time. For example, ifTOl presented an ^-approximate solution to find the MWIS (maximum weight 
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independent set) on planar graphs, and this was extended by several authors to more general classes of graphs. In 
1121, US, an ^-approximate MWIS for a large class of wireless networks in the Euclidean space is provided. In 
our model, we assume an ^-approximate MAX- WEIGHT computes an ^-approximate solution r\t) for each time t 
so that the potential decrease is at least {I — s) times the maximum possible potential decrease at time t. We will 
prove the stability of any ^-approximate MAX- WEIGHT protocol under A(cj, e) for e > 0, if < £ < e. 

Theorem 9: For < e < £, any ^-approximate Max-Weight(/3) is stable under A{uj^ e). 

Proof: Let e = then A(a;,e) is A{uj^e). As in the statement of Theorem [2j if we can associate the 
injection of p G P U with a set of partial transmissions F^, so that the sum of potential changes due to this 
injection to a queue of height g > is less than — + l)ipq^, then all the other arguments in the proof of 
Theorem |4] holds when we replace e with e. 

As in the proof of Theorem |2j we define d'p^^{t') = ^dp^e{t') for all eeE,t' eW, and peP U P'^. Then 
we show that dp^^{t) satisfy ^ if we substitute e by e. As in the proof of Theorem [2] in [?], we define 



KM) = E4..(...«.)(*')((<,d.)'' 



= (l-£)i^e,(0. (18) 

By the definition of e-approximate MAX- WEIGHT, we can take s^^ {t') for each Cj = {vj^Uj) e E, t' eW such 
that 

k 

fj Uj iCla 

> E(l-^>e.(t){(<.^,(,))''-«^^,<,,)''} (19) 



for some destinations d^a^^ for each Cj. By \\^ and (|19|), we can recursively assign 



r T/((j-l)m+(i-l)).,,x K'^'~^^it') 

r , ,(t') - min I - ^ s^'-^^(t') ^ ^ 



where ej = {vj^uj) and di is the destination of pi, in the same manner as in the proof of Theorem [5] Then, for 

all Cj e E,t' e W, and pi e P U 

eeE p,d eeE 

Let Tp. = {sp^^ej{t'))ejeE,t'ew for each pi G P UP~^, we obtain that the sum of potential changes due to 
this injection is less than (/3 + l)q^ by using the same argument in section 4.1. This in turn implies that 
£-Max-Weight(/3) algorithm is stable under A{uj, e). ■ 

VII. Experiments 

A. Simulation Setup 

We now describe a numerical experiment that aims to understand the queue size dynamics of the Max-Weight 
protocol under the adversarial model. Consider a ni x n2 simple grid graph G, and let n = nin2- Then, there 
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Fig. 3. The above 3 underlying graphs express which edges are not available under r^-^\r^'^\ r^^^. 



are 4n — 2ni — 2n2 directed edges in the graph. We assume that all single nodes can be a destination. We let 
rii = 3, 712 = 4, so n = 12, and 4n — 2ni — 2n2 = 34. 

In our simulation, we used 3 different edge rate vectors r'^^^ r'^^^ r*^^^ G M^^ for G. For each r*^*\ 1 < z < 3, we 
select 3 edges among 17 possible edges, and remove them. The underlying graphs of r'^^^ r'^^^ r*^^^ are described 
in Fig 3. Other directed edges have edge rates chosen independently and uniformly at random from [0.5,2]. We 
used the node-exclusive constraint model, i.e., matching constraint model. 

Among n{n — 1) many distinct source-destination pairs (S-D pairs), we randomly chose K many S-D pairs 
(si, ),..., (sx, dx) for K = 10. When the set of feasible edge rate vectors R is fixed for all time t > 0, 
we define the feasible arrival rate as follows. The collection of all the feasible arrival rate vectors are called the 
network stability region. 

Definition 4: The arrival rate vector 7 = (71, ... , 7^) G [0, 1]^ corresponding to the S-D pairs (si, di), . . . , 
{sk^ dx) is said to feasible, if there exist flows, (/^, . . . , f^) such that 

1) For each I < j < K, routes a flow of at least rj from Sj to dj. 

2) The induced net flow on the directed edges, / = Ylf=i belongs to the interior of co{R) where co{R) is 
the convex hull of R. 

If an arrival rate vector is in the interior of co{R), and the arrivals are identical for all time, then MAX- WEIGHT 
is stable |12|. Moreover, if an arrival rate vector is in the interior of co{RY , then MAX- WEIGHT is unstable. We 
chose K many source-destination pairs at random. For each r'^*^ 1 < z < 3, we compute 3 different feasible arrival 
rate vectors that are closed to the boundary of the network stability region. To do so, we fixed random arrival 
rate vectors 7(1), 7(2)^ ^(3) ^j^^^ entry has a value from [0.5,2]. We computed constants Qj, by binary 
search, for edge rate vector r*^*\ and arrival rate vector 7*^^^ so that cij^^^^ is stable under Max-Weight, and 
{cij +0.001)7'^-^^ is not stable under Max-Weight, as described in Fig 4. Each Cij varied from 0.098 to 0.178 in 
our simulation. We used a sufficiently large time window of size 10^ so that we could check the stability. 

We did two set of experiments. In both of those experiments, we divided the time t > into non-overlapped 
sub-windows of ordered phases. The first phase is t G [1, [1.5]], the second phase is t G [[1.5] + 1, [1.5 + (1.5)^]], 
and for each i > 1, the ith phase is: t e [[Ej=i(l-5p"^] + 1, [Ej=i(l-5y]]. 

In the first experiment, we fixed the edge rate vector r^*^ for some i G {1, 2, 3}. Over time the adversary injects 
packets as follows. For t > 0, if t is in the j-th phase, then inject packets with an arrival rate Cfj^^^^ where 
jG {1,2,3} and J = j {mod 3). 
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Fig. 4. For each pair of edge rate and arrival rate vector, the plot represents the change of the maximum size of queues for Cij^^^^ and 
{cij + 0.01)7(^) in the time window [0,10^]. 



In the second experiment, over time the adversary determines edge rate vectors and packet arrivals as follows. 
For t > 0, if t is in the i-th phase, we assign an edge rate vector r*^*^ where i G {1, 2, 3} and i = i {mod 3), and 
we assign an arrival rate vector cij^^^^ at random. 

Notice that, in both experiments, the average of the arrival rate vectors until time T does not converge as T goes 
to infinity. Also in the second experiment, the same holds for the edge rate vectors. However the above injections 
satisfy the definition of A{uj^e) for some > and a small e > 0. In both setups, we observed the dynamics of 
the maximum queue sizes over time. 

B. Simulation Results 

For the first experiment, as Fig 5 shows, for each edge rate vector, Max-Weight is stable with the above cyclic 
rate vectors. Interestingly, the maximum queue size may increase in some sub- window, but it decreases rapidly 
when the new sub- window starts. This is because the congested edges are different for each arrival rate vector, and 
the traffic-congestions are resolved when the arrival rate is changed. Notice that the maximum queue sizes for the 
cyclic rate vector case are bounded above and bounded below by some fixed arrival rate vector cases respectively. 

The queue dynamics for the second experiment are described in Fig 6. The gray lines describe queue sizes for 
fixed edge and arrival rate vectors. The black line describes the queue size for the cyclic rate vector case. Again, 
the maximum queue sizes for the cyclic rate vector case are bounded above and bounded below by some fixed 
edge and arrival rate vector cases respectively. From our two experiments we observe that Max-Weight make 
the system stable under A{(jJ^£) even when the edge and arrival rate vectors do not converge over time. 
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Fig. 5. For the edge rate vector we plot the maximum queue size when we use fixed arrival rate vectors 0117^-'^^ ci2j^'^\ ci3j^^\ and 
a cyclic arrival rate vector. 



Cyclic 3 edge-rates & feasible arrivals 

120 J I 




Fig. 6. We use the randomly cyclic edge and arrival rate pairs. It shows the stability of Max- Weight. 
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VIII. Conclusion 

In this paper we have shown that the Max-Weight protocol remains stable even when the traffic arrivals and 
edge rates are determined in an adversarial manner. 

In our opinion the most natural open question concerns the bound on queue size. Our analysis gives a bound 
that is exponential in the network size and we have shown in Section 5 that such a bound is unavoidable in the 
general case. However, achieving these large queue sizes involves choosing the achievable rate vectors R(t) in a 
very specific manner. We are interested in whether there are any simple sufficient conditions on the sets R{t) which 
would ensure that such large queues do not occur. 
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Appendix 

Proof: Now, for t^t' ^ W, \(lud~ ^ud\ — ^^max^ since at each time slot, at most i?max amount of data can 
move along a link from u. Hence by considering cj and n and i^max as constants, we obtain that for any t^t' e W, 

Suppose that a packet p with size £p is injected at a node ^'o at time to G W. Let d be the destination of p. Then, 
the potential change due to the injection of p is, 

{x,y)eEt'ew 



> 



> 



> 



> 



u,u)e'^p few 



e={v,u)e'^p few 
l-s/2 



e={v,u)e'^p 



because {"^t'ew ^(P^ ^^^Ol ^ ~ holds for all packet p and edge e. 

The increase of potential due to the direct injection of p is ip{P + d)^ +^p^((^^o d)^~^)- Hence the total 

change of potential induced by this injection of a packet p is, 

-EE + 1) \iqi:,r - {qi:,r + o {{qiyr-' + {qi:,r-') 

(x,y)eEt'ew 

< -Y^^p(^ + ^uu' + {{qt,r-') . 

Hence there is a constant g*, depending on n, uo and e, so that if q>q'' the sum of potential changes due to the 
injection is less than — f^^g^. ■ 



